Strong and weak chaos in nonlinear networks with time-delayed couplings 
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We study chaotic synchronization in networks with time-delayed coupling. We introduce the 
notion of strong and weak chaos, distinguished by the scaling properties of the maximum Lyapunov 
exponent within the synchronization manifold for large delay times, and relate this to the condition 
for stable or unstable chaotic synchronization, respectively. In simulations of laser models and 
experiments with electronic circuits, we identify transitions from weak to strong and back to weak 
chaos upon monotonically increasing the coupling strength. 
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The cooperative behavior of a system of interacting 
units is of fundamental interest in nonlinear dynamics. 
Such complex networks have a wide range of interdisci- 
plinary applications ranging from neural networks to cou- 
pled lasers [1,. Typically, these units interact by trans- 
mitting information about their state to their partners, 
and in many applications the transmission time is larger 
than the time scales of the individual units. Thus, net- 
works with time-delayed couplings focus of active 
research [5]. 

Time-delayed feedback can produce dynamical insta- 
bilities which may lead to deterministic chaos [3 - 5, . Even 
a scalar differential equation with time-delayed feed- 
back has an infinite-dimensional phase space which favors 
chaotic solutions. In physics, a single semiconductor laser 
produces a chaotic signal when its laser beam is reflected 
back into its cavity by an external mirror. Networks 
of nonlinear units may, similarly, become chaotic due 
to time-delayed coupling of the nodes. For networks of 
identical units, one often observes chaos synchronization. 
Even if the delay times are very long, the units may syn- 
chronize onto a common chaotic trajectory without time 
shift (zero-lag synchronization) [6^, '7^ . Other kinds of syn- 
chronization are possible, as well, like phase, achronal, 
anticipated and generalized synchronization, but here we 
only consider zero-lag synchronization. Chaos synchro- 
nization is being discussed in the context of secure com- 
munication [8]. 

In this letter we investigate networks with time-delayed 
couplings in the limit of large delay times [71 [S], and 
show that transitions between two kinds of chaos, namely 
strong and weak chaos, can be induced by changing the 
coupling strength. For strong chaos the largest Lyapunov 
exponent (LE) is of the order of the inverse time scales of 
the individual units and independent of the delay time, 
hence two nearby trajectories separate very quickly. For 
weak chaos, however, the LE is of the order of the in- 
verse delay time, hence nearby trajectories separate very 



slowly. We show that these two types of chaos possess 
very different synchronization properties: Networks with 
strong chaos cannot synchronize, whereas for weak chaos, 
networks can synchronize if the product of the LE and the 
delay time is sufficiently small compared to the eigenvalue 
gap of the coupling matrix, i.e. the difference between 
the row sum and its largest transversal eigenvalue. 

We illustrate our general findings by the example of 
a semiconductor laser network modeled by the Lang- 
Kobayashi (LK) rate equations, and by experiments on 
chaotic electronic circuits. 

We consider networks of N identical units with vari- 
ables Xi(t) e M", i = 1, . . . , N, which obey the equations 

i.(t) = F[x,(t)]+a^G.,H[x,(<-r)] . (1) 

i 

The nonlinear function F describes the local dynamics 
of the individual units. The units are connected by the 
coupling matrix G = {G.y G M}, which describes the cou- 
pling topology and the weight of each link. The coupling 
itself is characterized by the coupling function H, the 
delay time r and the strength a. We consider coupling 
matrices G with normalized row sum Cl2j Gij = 1), such 
that complete synchronization Xi{t) — s(t) is a solution 
of Eq. (0, 

s(i) =F[s(i)] +fTH[s(t-T)] . (2) 

The dynamics s{t) within the synchronization manifold 
(SM) is identical to the dynamics of a single unit with 
time-delayed feedback. The LEs of a single unit are ob- 
tained from linearizing Eq. ^ which gives 

i(t) = DF[s(t)] m + ^ Off - r)] i{t ~ t) . (3) 

The maximum LE Am of Eq. (|3| is a measure of the 
chaoticity within the SM. ft turns out that it is useful to 
consider the maximum LE Aq from an integration of the 
reduced linear system [4] 

m = mmm- (4) 
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We call this LE Aq the instantaneous Lyapunov exponent 
of the system, since there is no delayed term in the corre- 
sponding variational equation. Note, however, that this 
should not be confused with a finite-time LE. Further- 
more, Aq still depends on the coupling strength cr, since 
Eq. Q contains the trajectory s(<). The following results 
hold in the limit of large delay times r: Weak chaos oc- 
curs if Aq < 0; in this case Am = Tj/r in the leading order, 
where rj is independent of r. Strong chaos is encountered 
if Aq > 0; here Am ~ Aq up to a correction which is ex- 
ponentially small with respect to r. At first, we give a 
sketch of the proof. 

Weak chaos (Aq < 0) — Let us denote by X{t, s) the 
fundamental matrix solution |10| of the instantaneous lin- 
ear system Eq. Q. In the case of weak chaos, it satisfies 
\\X{t, s)\\ < M c^i*-"^) with negative Aq. Let us split the 
solution of Eq. ([3| into pieces of the length r as follows 
^.{e) ■= 1(6* + Tj) with < 9 < T. Then, can be 
expressed using the variation of constants formula [10_ as 
follows 

+ a X,{e,t')BH[sit' -T)]^^_,{t')dt' (5) 
Jo 

where Xj{e,t') = X{e + Tj,t' + rj). Using the 
exponential decrease of Xj{6,t'), it is straightforward 
to obtain from Eq. ^ the estimate maxg ||^j(6')|| < 

L maxg < maxg ||^o(^)ll' where L is some 

constant. This immediately implies that the exponential 
growth of the solutions is possible only with respect to 
the slow time j = t/r [4, 5 , and, hence, the maximum 
LE is scaled by 1/r in the case when Aq < 0. Strictly 
speaking, the constant L depends on r, since the prop- 
erties of the chaotic attractor change with r. However, 
we argue that for large t this dependence disappears: A 
chaotic attractor is characterized by its "skeleton" of pe- 
riodic orbits and in particular by the orbits of low period. 
The set of periodic orbits, which exists for low values of 
T, reappears generically also for larger delays fTTj. Thus, 
we conjecture that in the limit of large r generically all 
characteristics of the attractor converge to a limit and in 
particular L becomes independent of r. All experimental 
and theoretical results about chaos in delayed systems, 
for instance in lasers with delayed self-feedback and op- 
toelectronic oscillators [12], support this argument [131. 

Strong chaos (Aq > 0) — Let us make the coordinate 
transformation to the frame diverging exponentially with 
rate Aq, i. e. ^(t) — e^°* In the new coordinates, the 
variational Eq. ([s]) has the form 

u(i)=(DF[s(<)]-Ao/)u(i) 

+ cre-^o^Di7[s(i-r)] u(i-T) , (6) 

where the largest LE of the instantaneous vector field is 
zero. Applying the same arguments to the rescaled sys- 
tem (IgI as in the case of weak chaos, we conclude that 
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Figure 1. (Color online) (a) Maximum Lyapunov exponents 
Am (solid line) and Ao (dashed line) of the synchronization 
manifold (SM) for r = 10 ns vs. coupling strength o. (b) En- 
larged view for small coupling strengths cr. 

the maximum LE for u(i) is at most of the order l/r 
and converges to zero for large delays. Hence, Aq ap- 
proximates Am for large r. Numerical calculations (see 
below) show that, in fact, the largest LE converges to 
Ao with an error e"^"^, > 0. The convergence rate, 
however, is much slower than in the case of steady states 
[Tl] . Note that the existence of LEs that are independent 
of T has also been reported in [4 for time-discrete maps 
with delay. Such exponents have been called anomalous 
there. They can be also computed by regarding Eq. ([s]) 
as a nonautonomous differential equation with the delay 
term acting as "stochastic contribution". Note further 
that in most chaotic delayed systems that have been stud- 
ied, such as Ikeda and Mackey-Glass oscillators, the local 
dynamics is a constant damping, such that these systems 
only exhibit weak chaos. We thus propose to investigate 
delayed systems with strong chaos, such as lasers with 
delayed feedback in certain parameter regimes, further, 
since these systems may have important applications for 
instance as random number generators [15 . 

Consequences — We now discuss the consequences 
of these results for systems with large delay. For strong 
chaos, the maximum LE of the system is already given by 
the instantaneous term, Eq. (|4|. The coupling strength 
a contributes only indirectly through the orbit s{t). For 
weak chaos, however, chaos is generated by the delayed 
term with strength cr in the variational equation, and the 
maximum LE is of order 1/t. It is important to note here 
that both types of chaos are delay-induced. In fact, the 
laser system that we consider exhibits stable continuous 
wave output without delayed feedback. 

Our theoretical predictions are compared to numeri- 
cal simulations of the LK equations modeling a semicon- 
ductor laser with optical feedback. Now the variables 
Xi(t) g M'^ contain the real and imaginary parts of the 
electromagnetic field and the charge carrier inversion. 
Details of the equations and parameters can be found 
in [9 . Fig. [T| shows the two maximum LEs Am and Ag as 
a function of the coupling strength cr. Without coupling, 
cr = 0, the laser relaxes to a constant intensity, both LEs 
are zero and correspond to the Goldstone mode. For a 
small coupling, the laser becomes chaotic but the instan- 
taneous LE is negative, i.e., the chaos is weak. With 
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Figure 2. (a) Am t for the SM vs. delay time r in the regime 
of weak chaos {a = 21 ns""*^). (b) In(|Am — Aol/cr) for the SM 
vs. delay time r in the regime of strong chaos {a = 12ns~^). 
Parameters as in Fig. [l] 
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Figure 3. (a) Am t for the SM vs. coupling strength a for 
r — 100ns. (b) Am T for the SM vs. ln((T/|Ao!) in the regime 
of weak chaos near the left (gray line) and right (black line) 
divergences. 



increasing coupling strength. Ao increases to positive val- 
ues. Hence, the laser is strongly chaotic in some interval 
of a. For higher values of a, the laser is weakly chaotic 
again. 

Fig. shows A,n r as a function of the delay time r in 
the regime of weak chaos. We observe that this product 
saturates at a constant value for large delay times. Note 
that for our parameters a delay time of 200 ns is much 
larger than the internal time scale (Ins). For the regime 
of strong chaos, Fig. depicts ln(|Ani — Ao| /cr) as a 
function of the delay time r. We observe that it decreases 
linearly with t in agreement with the analysis of Eq. (|6| . 

At the transitions from weak to strong chaos, AmT 
diverges as shown in Fig. [sjja). In order to obtain the 
scaling for this divergence, we first consider the simple 
case of a scalar delay equation s = F{s) + bs{t — r) 
with constant coefficient b. The corresponding charac- 
teristic equation of the fixed point is Am = Ao + foe^'^™ 
which can be solved using the Lambert-W function. For 
Ao — ^ 0—, which corresponds to the transition from weak 
to strong chaos, it predicts a divergence of Am t with 
ln(6/|Ao|). Assuming that the coupling strength b in this 
simple model can be identified with a in the chaotic LK 
equations, we observe a similar scaling for the divergence 
of Am T at the two critical points of small and large values 
of a. Fig. [sj^b) reveals that Am t indeed depends linearly 
on ln(CT/|Ao|). The slope is within the same order of mag- 
nitude as for the simple case of steady states but system- 
atically larger. This deviation is related to the chaotic 
time dependence of Eq. (|3| and differs between the left 
(gray) and right (black) divergences since the degree of 
chaotic fluctuations is different for small and large a. 

Up to now we have considered a single unit with time- 
delayed feedback or, equivalently, the dynamics in the 
SM Eq. ([2|. The stability of chaos synchronization can 
be computed using the master stability function [16 . It 
is defined as the maximum LE A(re"'') arising from the 
variational Eq. (pi where a is replaced by the complex 
parameter or e''^(the input trajectory s(t) is still gov- 
erned by Eq. ([2|). For a given network the stability of the 
synchronized solution is determined by the eigenvalues of 
G. 

Due to the unity row sum the coupling matrix G has 



one eigenvalue 7 = 1 with eigenvector (1,1,... ,1), which 
corresponds to perturbations in the SM. The other iV — 1 
transversal eigenvalues 71, . . . ,7jv-'i correspond to per- 
turbations transversal to the SM. Synchronization in the 
network is stable if A((T7fc) < for all transversal eigen- 
values 7fc. 

We now show that synchronization is stable for weak 
chaos if 

|7max|<e-^"^ (7) 

where 7max is the transversal eigenvalue of G with largest 
magnitude 

As follows from the large delay case, A(re"^) 

does not depend on the phase ip, and there exists a crit- 
ical value ro for the stability of the variational Eq. ^ 
(A(?'o) = 0); i.e., for r < ro, the perturbation ^{t) van- 
ishes asymptotically ^{t) and grows otherwise. The 
maximum LE is zero for ro. If the maximum LE Am for a 
given (7 is known, then the threshold ro can be expressed 
as 

ro = ae-^'"^. (8) 

This can be shown by the following arguments. 
Let us make the coordinate transformation ^{t) — 
u(i) exp[i ln((T/ro)/T] in Eq. (|3|. Then the variational 
equation in the transformed coordinates reads 

u{t) = (BF[s{t)]-hn(^^y^ u(t) 

+ roBH[s{t-T)]u{t-T) . (9) 

The term ln(cr/ro)/T in the instantaneous part of the vec- 
tor field does not influence the maximum LE of Eq. ([9f 
in leading order 1/r for weak chaos. Indeed, by substi- 
tuting u ^ e^'^'i^+i/'^ we see that only the terms |u| ^ w, 
|DF[s(f)]u| - 1, as well as \roDH[s{t - T)]u{t - t)\ - 
ro e ' contribute to the leading order. Hence, the max- 
imum LE of Eq. ^ is zero, as well, and we obtain 
Am = ln(o'/ro)/T, taking into account the relation be- 
tween u and ^. This leads to the estimate ([s]) for 
the critical value ro. Then synchronization is stable if 
A(i7 7fe) < 0, and hence if |cr7fc| < ro for all k. With 
Eq. ^ this results in Eq. ([?]). 
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Figure 4. (Color online) (a) Experimental setup to measure 
the difference between strong and weak chaos, (b) Simulated 
Am (solid line) and Ao (dashed line) of the SM of the two elec- 
tronic circuits and experimentally measured cross-correlation 
C (red (gray) line) between the maxima of the time series of 
the two electronic circuits vs. coupling strength a. 

The condition ([T]) rules out synchronization for net- 
works with strong chaos since the right-hand side of 
Eq. ([7| decreases to zero in the Hmit of large delay times 
T. For weak chaos, however, one can always find networks 
for which Eq. ([t]) is true, i.e., chaos synchronization is 
stable. In addition, for weak chaos, condition ([t]) be- 
comes independent of r, as r — > const, in agreement 
with recent results jT] 12] • The network can be synchro- 
nized in this case even for arbitrarily large r if Eq. ([7| is 
fulfilled. 

For a single laser with feedback we have found a sce- 
nario leading from weak to strong chaos and back to weak 
chaos with increasing feedback strength a. But also for 
networks outside the regime of synchronization, we can 
define an instantaneous LE for each unit by the maximum 
LE of the equation ^(i) = D_F[xi(t)] ^(t). Simulating this 
together with Eq. ([ij for a triangle of bidirectionally cou- 
pled lasers, we found similar results as in Fig.[T] The net- 
work changes from weak to strong chaos and back to weak 
chaos with increasing coupling strength a. The critical 
coupling strengths, however, have different values. 

Finally, we have performed an experiment with two 
coupled electronic circuits [T7] to measure the difference 
between strong and weak chaos. For general chaotic net- 
works, one can add two identical units which are driven 
by one unit of the network with identical strengths, simi- 
lar to the test for generalized synchronization |18j . Chaos 
is weak if and only if the two units synchronize. For de- 
termining the type of chaos on the SM, it is sufficient to 
add one unit which is driven by a single unit with delayed 
feedback representing the SM, as sketched in Fig. |4|^a). 
The stability of synchronization of the two units is given 
by Eq. (|4]). Fig.[4|^b) shows the simulated LEs Am and Aq 
of the SM in comparison with the experimentally mea- 
sured cross-correlation C between the maxima of the time 
series of the two electronic circuits as a function of the 
coupling strength a. For small a we observe zero-lag 
synchronization of periodic dynamics. With increasing a 
the dynamics becomes chaotic while complete synchro- 



nization is maintained. With further increase of cr the 
cross-correlation first decreases and then increases again 
until synchronization is reached once more, indicating 
transitions from weak to strong chaos and back to weak 
chaos. 

The notion of strong and weak chaos allows for a classi- 
fication of the synchronizability for coupled chaotic nodes 
and, most notably, shows a significant difference of the 
chaotic behavior, characterized by the maximum and the 
instantaneous LE. Our findings are promising for applica- 
tions in laser dynamics and beyond. In random number 
generators, where a high entropy is crucial, the regime 
of strong chaos will potentially lead to an increase in 
randomness. Similarly, in other applications like opto- 
electronic oscillators, devices can be deliberately con- 
structed to operate in the regime of strong chaos. 
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